DIGITAL CAMERA, IMAGE SIGNAL PROCESSING METHOD 
AND RECORDING MEDIUM FOR THE SAME 



[0001] This application is based on application No. 
2000-89093 filed in Japan, the content of which is hereby 
incorporated by reference. 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0002] The present invention relates to a digital camera which 
has a function of shading correction and/or edge enhancement/ 
and an image signal processing method and a recording medium 
for the same. 

Description of the Prior Art 

[0003] In general, when an image is taken using a lens of 
a camera, a so-called image field edge brightness reduction 
phenomenon is created which is a (shading) phenomenon that the 
light amount decreases with a distance from a central point of 
the image to an edge of the image. In general, the smaller the 
f-number (= focal length / effective aperture) is, the larger 
the influence of the image field edge brightness reduction 
phenomenon is. 

[0004] In general, in the case of a silver halide film, since 
a change in output characteristic exhibits a curved profile as 



the amount of incident light changes, despite a certain degree 
of the image field edge brightness reduction phenomenon, it is 
not noticeable in many cases. However, in the case of imaging 
equipment, such as a digital camera, which uses a CCD (Charge 
5 Coupled Device) which comprises a plurality of, e.g., 1 . 5 to 
3 million pixels arranged in the form of array as an image pickup 
element, an output characteristic of the CCD changes stepwise 
pixel by pixel in accordance with a change in the amount of incident 
light, and therefore, a brightness difference of an image is 

,fi 10 noticeable in many cases because of the image field edge 
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t2 brightness reduction phenomenon. Noting thiS/^.. imaging 

equipment which uses a CCD performs correction of an image field 
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edge brightness reduction for correcting a difference between 



q the brightness in a portion in the vicinity of a central point 

fy — - - - - ~ ^ 

ry 15 and the brightness in a peripheral portion, namely, shading 

tji ^ ^ - . * " ------- 

p correction, on each pixel of an image which was taken . A digital 

camera, in particular, executes shading correction by means of 

digital image processing, regardless whether a still image is 

taken or a movie image is taken. 

20 [0005] For example, where a peripheral area in which a light 
amount decreases and a drop rate in the peripheral area are known 
in advance, multiplication of an inverse number of the drop rate 
at this position realizes shading correction. After reading 
image data of an image by a CCD and storing the image data in 

25 a predetermined image memory, a correction value is generated 
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using a two-dimensional coordinate and a function, and a 
peripheral area with the deceased light amount is 
shading-corrected. In this case, correction values are stored 
in other memory as a correction table, and multiplication of 
5 the image data is executed using each correction value as a 
coefficient, to thereby correct the decreased light amount in 
the peripheral area. 

[0006] In general, as a correction value for shading 
correction or the like, data which correspond on one-to-one basis 
10 to data regarding the respective pixels are necessary for the 

Co 

j,i purpose of accurate correction. 

Ifl [0007] For instance, image data expressed by 2048 pixels in 

the horizontal direction and 1536 pixels in the vertical 
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jpg direction result in approximately 3 . 15 million pixels . In order 

Id 

jry 15 to assign correction values individually to all pixels of such 

£n 

« a large quantity of image data corresponding to as many as 3.15 

million pixels, when a correction value of eight bits is to be 
used for each pixel, for example, it is necessary to prepare 
a correction table whose size is about three MB as the correction 
20 values. Further, since a pixel number of a CCD is expected to 
increase to 4 to 5 million in the near future, a data size of 
a correction table is expected to swell up even further to as 
large as 4 to 5 MB. 

[0008] In addition, when parameters of optical conditions 
25 such as zooming and a stop change, more than one data tables 
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are necessary for each one of those parameters, which in turn 
increases the total volume of data by several folds* 
[0009] Noting this, to decrease the size of a data table of 
correction values, one piece of correction data may be set for 
each block of 4X4 pixels, for instance, to correct block by 
block. In this case, the size of a data table of correction 
values is 1/16 of that when correction values are prepared each 
for each one of pixels. 

[0010] However, in this case, since correction values sharply 
change at contours of blocks, depending on the degree of data 
correction, a step on blocks becomes noticeable in a peripheral 
area of an image on a screen, which may deteriorate the quality 
of the image. Hence, in order to maintain an image quality at 
ja constant level, the conventional approaches have no other 
^alternative but to suppress the degree of shading correction, 
jcorrection of edge resolution reductions or the like to a certain 
limit . 

[0011] Further, while the conventional approaches realize 
shading correction by means of digital image processing as 
described above, among characteristics of a general lens is an 
image field edge resolution reduction phenomenon that a 
resolution in a peripheral area of an image becomes lower than 
a resolution in a central area of the image, and the phenomenon 
varies a distribution of an MTF (Modulation Transfer Function) . 
As the image field edge resolution reduction phenomenon has not 




been so far addressed by any digital image processing, the image 
shows increasingly blurred with a distance toward the peripheral 
areaof the image from the central areaof the image, and therefore, 
the quality of the image is poor. 

5 

SUMMARY OF THE INVENTION 
[0012] Accordingly, an object of the present invention is 
to provide a digital camera, and an image signal processingmethod 
and a recording medium for the same, with which it is possible, 
P 10 during shading correction, to reduce a load in digital image 

■sesr 

CO processing which is associated with a reduced amount of 

N| correction values, while preventing a deterioration in the 

in 

fU quality of an image. 

in 

9 [0013] Another object of the present invention is to provide 

P 

IU 15 a digital camera, and an image signal processing method and a 

m 

recording medium for the same, with which it is possible to easily 

P 

correct a reduction in resolution in a peripheral area. 
[0014] To solve the problems described above, one aspect of 
the present invention is to provide a digital camera comprising: 

20 an image pickup element for capturing an image; a correction 
value memory for storing predetermined light amount correction 
data each set in advance for each one of predetermined blocks 
which are obtained by dividing the entire area of the image 
captured by the image pickup element into at least a central 

25 area and a peripheral area; a correction value generator for 
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generating correction values regarding light amounts at the 
respective target pixels within the blocks based on the plurality 
pieces of light amount correction data which are held in the 
correction value memory; and an edge brightness reduction 
5 corrector for correcting image field edge brightness reductions 
at the respective pixels based on the correction values regarding 
light amounts generated by the correction value generator. 
[0015] Another aspect of the present invention is to provide 
a digital camera comprising: an image pickup element for 
O 10 capturing an image; a correction value memory for storing 
S9 predetermined resolution correction data each set in advance 

s 4 for each one of predetermined blocks which are obtained by 

m 

FU dividing the entire area of the image captured by the image pickup 

in 

^ element into at least a central area and a peripheral area; and 

o 

W 15 an edge enhancer for edge-enphasi zing the respective pixels based 

ru 

CH on the resolution correction data which are held in the correction 

C3 

value memory to thereby correct image field edge resolution 
reductions. 

[0016] Further aspect of the present invention is to provide 
20 an image signal processing method for a digital camera, 
comprising: generating, at which in a condition that a 
predetermined correction value memory holds predetermined light 
amount correction data each set in advance for each one of 
predetermined blocks which are obtained by dividing the entire 
25 area of the image captured by an image pickup element into at 
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least a central area and a peripheral area, correction values 
regarding light amounts at the respective target pixels within 
the blocks based on the light amount correction data; and 
correcting image field edge resolution reductions at the 
respective pixels based on the generated correction values 
regarding the light amounts. 

[0017] Still further aspect of the present invention is to 
provide an image signal processing method for a digital camera, 
comprising : in a condition that a predetermined correction value 
memory holds predetermined resolution correction data each set 
in advance for each one of predeterminedblocks which are obtained 
by dividing the entire area of the image captured by the image 
pickup element into at least a central area and a peripheral 
area, executing edge-enhancement for the respective pixels based 
on the resolution correction data, to thereby correct image field 
edge resolution reductions . 

[0018] Still further aspect of the present invention is to 
provide a recording medium which stores a program for correcting 
light amount drops at the periphery of an image which is captured 
using a predetermined image pickup element of a digital camera, 
wherein the program is for executing a sequence in which, in 
a condition that, within the digital camera, predetermined light 
amount correction data each set in advance for each one of 
predetermined blocks which are obtained by dividing the entire 
area of the image captured by the image pickup element into at 
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least a central area and a peripheral area are held, generating 
correction values regarding light amounts at the respective 
target pixels within the blocks based on the light amount 
correction data, and for executing a sequence for correcting 
5 image field edge brightness reductions at the respective pixels 
based on the generated correction values regarding the light 
amounts . 

[0019] Still further aspect of the present invention is to 
provide a recording medium which stores a program for correcting 
O 10 resolutions at the periphery of an image which is captured using 
CO a predetermined image pickup element of a digital camera, wherein 

5 a 
scat 

% 4 the program is for executing a sequence in which, in a condition 

in 

fU that predetermined resolution correction data each set in advance 

in 

a for each one of predetermined blocks which are obtained by 

£3 

y 15 dividing the entire area of the image captured by the image pickup 

m s 
iU 

Ifl element into at least a central area and a peripheral area are 

□ 

S U held in the digital camera, the respective pixels are 

edge-enhanced based on the held resolution correction data, to 
thereby correct image field edge resolution reductions. 

20 [0020] These and other objects, advantages and features of 
the invention will become apparent from the following description 
thereof taken in conjunction with the accompanying drawings, 
which illustrate specific embodiments of the invention. In the 
following description, like parts are designated by like 

25 reference numbers throughout the several drawings. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
[0021] Fig. 1 is a plan view of a digital camera according 
to a first preferred embodiment of the present invention; 
5 [0022] Fig. 2 is a cross sectional view of the digital camera; 
[0023] Fig. 3 is a front view of the digital camera; 
[0024] Fig. 4 is a block diagram of the digital camera; 
[0025] Fig. 5 is a block diagram showing a bus, an image signal 
processor, etc.; 

*5 10 [0026] Fig. 6 is a block diagram showing a bus, an image signal 



m 



processor, etc . ; 



CO 
f* 

~y [0027] Fig. 7 is a block diagram showing a bus , an image signal 

in 

processor, etc.; 

[0028] Fig. 8 is a flow chart showing image capturing in the 



i . a 

if 15 digital camera; 

i y 

W [0029] Fig. 9 is a drawing showing a condition that the entire 

C3 

area of an image is divided into aplurality of rectangular blocks ; 
[0030] Fig. 10 is a drawing showing a positional relationship 
between a target pixel and neighboring blocks; 
20 [0031] Fig . 11 is a block diagram of an HV counter, acorrection 
value table and a correction value generator; 
[0032] Fig. 12 is a flow chart showing operations of the HV 
counter, the correction value table and the correction value 
generator; 

25 [0033] Fig. 13 is a block diagram showing an edge enhancer; 
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[0034] Fig. 14 is a drawing showing a condition that blocks 
in a peripheral area are set to be smaller than blocks in a central 
area; and 

[0035] Fig. 15 is a drawing showing a condition that reference 
positions are set at corner portions of the respective blocks. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
[0036] <Basic Structure of Digital Camera> 

[ 0037 ] Figs . 1 through 3 are drawings showing a basic structure 
of a digital camera 1, of which Fig. 1 is a plan view, Fig. 2 
is a cross sectional view as viewed from the A-A position in 
Fig. 1, and Fig. 3 is a back view. These drawings are not 
necessarily in accordance with the third angle projection, but 
conceptually show an example of the basic structure of the digital 
camera 1 . 

[0038] As shown in these drawings, the digital camera 1 has 
an approximately rectangular shape, and as shown in Fig. 2, 
comprises an image pickup circuit 302 which has a CCD color sensor 
303 at an appropriate position behind lens units 30 which form 
a taking lens. Further, the lens units 30 comprise a variator 
lens 300 and a compensator lens 301. 

[0039] On the other hand, disposed inside a camera main unit 
2 are a zoom motor Ml for changing a zoom rate of the variator 
lens 300 and a motor M2 for focusing by driving the compensator 
lens 301. 
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[0040] A grip portion G is formed as shown in Fig. 1 in a 
front surface of the camera main unit 2, and a built-in flash 
Sofa pop-up type is disposed to a top end portion of the camera 
main unit 2 at a proper position • Further, as shown in Fig. 
5 3, a top surface of the camera main unit 2 seats a shutter start 
button 9 . The shutter start button 9 has a function of detecting 
and judging a half-pressing state which is used as a trigger 
for adjustment of a focus and a full-pressing state which is 
used as a trigger to take an image for recording. 
£3 10 [0041] On the other hand, as shown in Fig. 3, a back surface 
£y of the camera main unit 2 seats a liquid crystal display (LCD) 

S! 10 for showing live view of a taken image and for reproducing 

in 

rU a recorded image and the like, and an electronic view finder 

in 

» (EVF) 20. Unlike an optical finder, the LCD 10 and the EVF 20 

id 15 which use an image signal received from the CCD 303 for displaying 

ry 

gfl serve as a finder. 

C9 

m [0042] In the back surface of the camera main unit 2, a 

record/play setting switch 14 is formed with which a "record 
mode" and a "play mode" are switched. The record mode is a mode 
20 for photographing, while the play mode is a mode for reproducing 
and displaying, on the LCD 10, a photographed image which is 
recorded in a memory card 8 . 

[0043] A four way switch 35 is disposed to a right-hand side 
portion of a back surface of the digital camera 1. With an 
25 L-button and an R-button pressed, the zoom motor Ml is driven 
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to thereby zoom up or down. Using a U-button, a D-button, the 
L-button and the R-button, various types of operations are 
performed. 

[0044] Further, the back surface of the camera main unit 2 
seats an LCD button 31, a Decide button 32, a Cancel button 33, 
and a Menu button 34. 

[0045] In addition, an external monitor terminal 222 is 
disposed to a side surface of the camera main unit 2 . The external 
monitor terminal 222 is a terminal for transmitting image data 
and the like from the digital camera 1 to an external monitor 
such as CRT. 

[0046] As shown in Fig. 1, the digital camera 1 can accept 
the memory card 8 . Used as a drive source for the digital camera 
1 is a power source battery E in which four AA batteries El to 
E4 are connected in series. 

[0047] <Basic Function of Digital Camera 1> 

[0048] Fig. 4 is a block diagram of a basic function of the 

digital camera 1. 

[0049] The CCD 303 photoelectrically converts an optical 
image of a subj ect focused by the lens units 30 into image signals 
containing color components of R (red) , G (green) and B (blue) 
(i.e., signals including a signal sequence of pixel signals 
received at the respective pixels) . The CCD 303 has 
approximately 3. 15 million pixels, 2048 pixels horizontally and 
1536 pixels vertically in the interline method. All the pixels 
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are read out in two times, 768 lines each. 

[0050] A signal processor 313 transfers digital image data 
to a CPU for the digital camera (hereinafter referred to as the 
"main CPU") , by means of CDS (correlative double sampling) and 
5 an A/D converter for receiving an output from the CCD 303 and 
converting the output into digital image data. 
[0051] A timing generator (TG) 314 is for generating various 
types of timing pulses which are used to control driving of the 
CCD 3 03, and has a function of switching the types of image signals 
? J 10 which are outputted by the CCD 303. The TG 314 and the CCD 303 
as they operate together realize imaging. 

[0052] The main CPU 21 has functions needed for the digital 
camera in one chip . The main CPU 21 comprises a signal processor 
211, a JPEG compressor/decompressor 212, and a video encoder 
IH 15 213. The main CPU 21 further has a memory card controller 214, 
a clock generator 215, SIOs (Serial Interface) 216, a RISC-CPU 
core 217 for controlling the respective portions, and a bus 
controller 218. 

[0053] The image signal processor 211 executes black 
20 correction, white balancing (WB) , pixel interpolation (CCD 
interpolation) , gamma correction, color spatial conversion for 
converting into YCrCb data, and additionally, image field edge 
brightness reduction correction, edge enhancement, etc. A 
function of the image signal processor 211 will be described 
25 later. 
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[0054] The JPEG compressor/decompressor (comp . /decomp . ) 212 
has a function of JPEG-compressing image data processed by the 
image signal processor 211 and JPEG-expanding image data which 
are read from the memory card 8 . 
5 [0055] The video encoder 213 processes image data generated 
at the image signal processor 211, converts the data into a digital 
composite signal which is compatible with a broadcasting scheme 
such as NTSC and PAL, and thereafter converts into an analog 
composite signal using a D/A converter. 
£3 10 [0056] The memory card controller 214 supplies image data 

:w 

CO or the like to the memory card 8 and retrieves image data or 

K 4 the like from the memory card 8. 

if! 

FU [0057] A clock generator 215 sends out a clock for the TG 

in 

* 314. 

S3 

UJ 15 [0058] The SIOs 216 transmit and receive control data to and 

ry 

CP from the signal processor 313, the TG 314 and a camera CPU 22. 

C3 

t& [0059] The bus controller 218 is for controlling data which 

are supplied to and outputted from an external memory 23 through 
abus219, serving also as a DMA (Direct MemoryAccess) controller. 

20 [0060] The external memory 23 is formed by a flash ROM 231 
which stores program data and a volatile DRAM (image memory) 
232 which accumulates image data and the like. It is possible 
to store, in the flash ROM 231, program data recorded in the 
memory card 8 which is a recording medium, via the memory card 

25 controller 214. This allows to reflect the stored program in 
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operations of the digital camera 1. A control program which 
will be described later can also be installed in the digital 
camera 1 from the memory card 8 . 

[0061 ] The camera CPU 22 controls the operations of the digital 
5 camera 1. That is, connected with an operating member 225 such 
as the shutter start button 9 which is manipulated by a user, 
detectors 226 which respectively show detected positions of 
mechanical mechanisms such as the lens units 30, and actuator 
drivers 227 which drive actuators such as the zoom motor Ml, 

^ 10 the camera CPU 22 executes a camera sequence. 

J? 

^0 [0062] <Data Transmission in Main CPU 21> 

^ [0063] Next, transmission of data within the main CPU 21 will 

m 

fU be described. The following functions of the main CPU 21 are 

5 executed in accordance with sequences which are described in 

C3 

W 15 a software program which is stored in the flash ROM 231 which 
[U 

tn is a rewritable recording medium. 

£3 

M= [0064] In the main CPU 21, using the functions of the bus 

controller 218 as a DMA controller, data can be transmitted 
directly between the DRAM 232 and the respective modules in which 
20 DMA channels are set. The DMA channels are set as described 
below (See Fig. 5) . 

[0065] (l)DMAl channel : Image signal processor — > DRAM, 

(2) DMA2 channel : DRAM — » Image signal processor, 

(3) DMA3 channel : Image signal processor — » DRAM, 
25 (4)DMA4 channel : DRAM — » JPEG comp . /decomp., 
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( 5 ) DMAS channe 1 

(6) DMA6 channel 

(7) DMA7 channel 

(8) DMA8 channel 



JPEG comp./decomp. — » DRAM, 
DRAM — » Video encoder, 
DRAM — > Memory card controller, 
Memory card controller — > DRAM. 
5 During controlling of DMA-based data transmission, first, 

a permission bit of a DMA setting register of the main CPU 21 
is enabled. As data to be transmitted from the respective modules 
are generated and a DMA transmission request is issued to the 
bus controller 218, the bus controller 218 judges the priority 
^ 10 of the DMA and the DMA is started up. With the DMA started up, 
the data can be transmitted directly between the respective 
modules and the DRAM 232. Further, the bus controller 218 
conciliates a bus 219 for every predetermined bytes, whereby 
conciliation vis-a-vis other DMA request is made. 



in 

ru 
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111 

15 [0066] During the conciliation, if entry of data via the CCD 



303 and outputting to the video encoder 213 are set with the 
highest DMA priority, for example, despite other DMA request, 
data transmission in these two channels precedes the other DMA 
request. Other DMA channels have the same priority levels, and 

20 when conciliation is necessary, a module executed by round-robin 
scheduling is given the lowest priority level so that the 
respective modules will be executed one after another. 
[0067] <Outline of Processing in Main CPU 21> 
[0068] Now, an outline of processing in such a digital camera 

25 1 will be described. 
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[0069] First, with respect to image processing for so-called 
live view in which still images are forwarded frame by frame 
to thereby display a pseudo movie image, in Fig. 4, the main 
CPU 21 controls the TG 314 through the SIOs 216 so that the TG 
5 314 is set to generate a clock frequency which is proper for 
a predetermined frame rate. At this stage, the main CPU 21 
enables the DMA3 channel for an output from the image signal 
processor 211 and the DMA6 channel for an output from the video 
encoder. Image data are thereafter fed sequentially from the 
-3 10 CCD 303 to the image signal processor 211. 

tQ [0070] In the image signal processor 211, as shown in Fig. 

5, black correction and white balancing are executed on the image 
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data in a processing part 211a which is for such processing, 

Iff. 

B and the image data are supplied to an image field edge brightness 

O 

W 15 reduction corrector 211e. Processing is stopped in the 

ry 

6} corrector 211e during operations for live view. Hence, the data 

£3 

M 5 fed from the processing part 211a are outputted as they are from 

the next processing part 211b. The processing part 211b 
interpolates CCD Bayer data into RGB data, and after processed 

20 with gamma correction, the data are outputted to a color spatial 
converter 211c to be converted into YCrCb. Following this, an 
edge enhancer 2 lid edge-enhances a Y-signal, and the result of 
this is written in the DRAM 232 using the DMA3 channel. The 
image data written in the DRAM 232 are transferred to the video 

25 encoder 213 using the DMA6 channel and the video encoder 213 
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thereafter generates and outputs a composite video signal, 
whereby the LCD 10, the EVF 2 0 or the like display an image. 
[0071] Next, an outline of image capturing will be described. 
In Fig. 4, instructed by the camera CPU 22 to capture an image 
which is to be recorded, the main CPU 21 sets the respective 
modules for capturing of the image which is to be recorded. In 
short, as shown in Fig. 5, the image signal processor 211 enables 
the DMA1 channel through the DMAS channel, sets and controls 
the TG 314 through the SIOs 216 so that the TG 314 is set to 
generate a clock frequency for capturing of the image which is 
to be recorded and so that an electronic shutter speed of the 
CCD 303 is as instructed by the camera CPU 22. 
[0072] In consequence, image data accumulated on the CCD 303, 
travelling a path as that denoted at the thick line in Fig. 6, 
are treated with various types of image signal processing . That 
is, as the image data accumulated on the CCD 303 are supplied 
to the image signal processor 211 through the bus 219, first, 
at a step S01 in Fig. 8, black correction and white balancing 
(WB) are executed in the processing part 211a which is disposed 
for such processing. Following this, at a step S02 in Fig. 8, 
the image f ield.edge brightness reduction corrector 211e executes 
shading correction. The shading-corrected image data are 
written as two fields in the DRAM 232 through the DMA1 (step 
S03 in Fig. 8) . 

[0073] At this stage, the corrector 211e, as shown in Fig. 



6, reads table data of the light amount correct ion data which 

r " """" ' " " ' ~~~ 

are stored in a correction value. _ table -2 llg based on a value 
which is set by an HV counter 211f which expresses the location 
of a target pixel, and a correction value generator 211h generates 
a correction value based on the value which is set by the HV 
counter 211f and the light amount correction data of the table 
data within the correction value table 211g. The image field 
edge brightness reduction corrector 2 lie multiplies the 
respective pieces of the pixel data by the correction values 
generatedby the correction value generator 211h and consequently 
performs shading correction, and writes the data in the DRAM 
232 through the bus 219 . The shading correction at the corrector 
211e will be described in detail later. 

[0074] With the image data written in the DRAM 232 frame by 
frame, as denoted at the thick line in Fig. 7, the data now on 
the DRAM 232 are thereafter written in the image signal processor 
211 through the DMA2 once again (step S04 in Fig. 8) . At this 
stage, the DMA2 scans and reads addresses in such a manner that 
the data written in the interlace method become as if they are 
written in the progressive method. 

[0075] In the image signal processor 211, the processing part 
211b for CCD interpolation and gamma correction interpolates 
the CCD Bayer data into RGB data and gamma-corrects the data 

(step SOS in Fig. 8), after which the data are converted into 
YCrCb data by the color spatial converter 211c (step S06 in Fig. 



8) . Following this, at a step S07 in Fig. 8, the edge enhancer 
211d edge-enhances the Y-signal. 

[0076] At this stage, the edge enhancer 211d reads table data 
regarding the resolution correction data stored in the correction 
value table 211g based on a value which is set by the HV counter 
211f and generates a correction value, as shown in Fig. 7. The 
edge enhancer reads the value of the correction value and changes 



the amount of an added high frequency component, to_^thjereby 
perform peripheral MTF correction. The edge enhancement will 

Q 10 be described in detail later. 
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[0077] The result of the edge enhancement is written in the 



^ DRAM 232 through the DMA3 channel (step S08 in Fig. 8). 

in 

fM [0078] Following this, with the YCrCb data all written in 

in 

3 „ the DRAM 232, the JPEG compressor/decompressor 212 reads the 

□ 

^ 15 YCrCb data using the DMA4 and performs image compression in the 

ry 

EH JPEG method (step S09 in Fig. 8) . The JPEG 

O 

compressor/decompressor 212 writes the compressed image data 
resulting from the image compression in the DRAM 232 once again 
through the DMAS (step S10 in Fig. 8) . The compressed image 

20 data within the DRAM 232 are thereafter read out (step Sll in 
Fig. 8) , transferred to the memory card controller 214 through 
the DMA 7 so that a file is created within the memory card 8 
(step S12 in Fig. 8) . 
J^[0079] <Detailed Description of Image Field Edge Brightness 

25 Reduction Correction> 
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[0080] Now, detailed operations of actual correction of image 
field edge brightness reductions will be described. 
[0081] The correction value table 211g, as shown in Fig. 9, 
stores in advance a correction value table which is formed by 
representative light amount correction data, namely, standard 
light amount correction data, each prepared for each rectangular 
block Bk which has 64 pixels in the horizontal direction and 
48 pixels in the vertical direction in within the entire screen 
which shows one image 41 . For instance, in the case of the image 
41 which is expressed by 2048 pixels in the horizontal direction 
and 1536 pixels in the vertical direction as that shown in Fig. 
9, the correction value table includes 34 X 34 = 1156 blocks 
which are expanded by one block Bke around the image 41. The 
correction value table holds standard light amount correction 
data whose each piece is taken at a reference position Pc within 
each block Bk. In the example shown in Fig. 9, the central points 
of the respective blocks Bk are the reference positions Pc, and 
predetermined standard light amount correction data which are 
based on actual measurements are stored in the correction value 
table. 

[0082] In this case, the standard light amount correction 
data includes 34 X 34 = 1156 data pieces regarding all blocks 
Bk. 

[0083] Each block Bk contains 3072 (= 64 X 48) pixels. As 
shown in Fig. 10, for generation of a correction value for a 
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desired target pixel Px within each block Bk, in the correction 
value generator 211h, the standard light amount correction data 
regarding four blocks (hereinafter referred to as the 
"neighboring blocks" ) Fl through F4, i.e., the block Bk to which 
5 the target pixel Px belongs and three neighboring blocks Bk which 
are close to the target pixel Px in the horizontal, the vertical 
and the diagonal directions, are weighted by distances, whereby 
the correction value for the target pixel Px is calculated. 
[0084] Fig. 11 shows an example of a structure of the correction 
10 value generator 211h. In Fig. 11, the HV counter 211f counts 
the pixels which are supplied sequentially to the image signal 
processor 211 as denoted at-, a step S21 in Fig. 12, to thereby 
detect and output a pixel position at which image field edge 
brightness reduction correction is being performed. The pixel 
15 position information is fed to both the correction value table 
211g and the correction value generator 211h. 
[0085] In the correction value table 211g, an HV decoder 45 
decodes the count result of the HV counter 211f, and as shown 
in Fig. 10, the four neighboring blocks Fl through F4 associated 
20 with the target pixel Px are selected (step S22 in Fig. 12), 
the standard light amount correction data are read from a 
correction value memory 4 6 (step S23 in Fig. 12), and the standard 
light amount correction data are outputted to a register 4 6a 
which is within the correction value generator 211h. With 
25 respect to the frequency of this, the standard light amount 
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correction data regarding the four neighboring blocks Fl through 
F4 are outputted for every 64 pixels, since the data are read 
continuously in a horizontal pixel direction during the image 
processing. 

5 [0086] The count result of the HV counter 211f is supplied 
to the correction value generator 211h as well as described above, 
as a value of remainder divided by 64 in the horizontal direction 
and remainder divided by 4 8 in the vertical direction. In the 
correction value generator 211h, an HV distance calculator 47 
10 calculates distances between the target pixel Px and the 
W reference positions (central points ) Pel through Pc4 of the four 

ess 
5 

^ neighboring blocks Fl through F4 as those shown in Fig. 10 based 

?y on the count result of the HV counter 21 If (step S24 in Fig. 

in 

a M 12) , and the distances are stored respectively in four distance 

p 

W 15 registers Rl through R4 . 

iy 

CH [0087] Following this, using the values stored in the distance 

H registers Rl through R4, the standard light amount correction 

data within the register 46a are weighted (step S25 in Fig. 12) . 
That is, multipliers 48 multiply the four pieces of the standard 
20 light amount correction data stored within the register 4 6a with 
the distance values stored in the distance registers Rl through 
R4, an adder 49 adds up the four values multiplied by the 
multipliers 48 and calculates a correction value. Using the 
correction value, the image field edge brightness reduction 
25 corrector 211e executes shading correction (step S26 in Fig. 
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[0088] The standard light amount correction data within the 
correction value memory 4 6 are stored in the flash ROM 231, and 
the values of the data can be changed appropriately in accordance 
with an optical condition . For example, when a user changes 
various optical conditions by means of zooming or manipulation 
of an aperture stop or the like, in accordance with the changed 
optical conditions, the data table of the standard light amount 
correction data is read out from the flash ROM 231 and written 
in the correction value memory 4 6, whereby image field edge 
brightness reduction correction is performed in accordance with 
the changed optical conditions. 

,[0089] <Detailed Description of Peripheral MTF Correction> 
[0090] Now, peripheral MTF correction will be described in 
detail . 

[0091] As. described above, as denoted at the thick line in 
Fig. 6, the image data once stored in the DRAM 232 through the 
processing part 211a for black balance correction and WB and 
the image field edge brightness reduction corrector 211e are 
supplied to the edge enhancer 211d after travelling through the 
processing part 211b for CCD interpolation and gamma correction 
and the color spatial converter 211c as denoted the thick line 
in Fig. 7 . The edge enhancer 211d thereafter performs peripheral 
MTF correction on a Y-signal component of a YCrCb-signal which 
is outputted from the color spatial converter 211c. 




[0092] Fig. 13 is a drawing showing a structure of the edge 
enhancer 2 lid which performs MTF correction. The edge enhancer 
211d, as shown in Fig. 13, comprises a high-pass filter Y-HPF 
and a low-pass filter Y-LPF for band separation of the Y-signal 
5 component of the YCrCb-signal which is outputted from the color 
spatial converter 211c, a first multiplier 52 which multiplies 
a high frequency component extracted by the high-pass filter 
Y-HPF by an edge emphasis amount 51 which is set by firmware 
to thereby amplify the amount of the high frequency component, 
^j 1 10 a secondmultiplier 53 whichmultiplies themultiplication result 
CO of the first multiplier 52 by peripheral MTF correction data 

V J /" (resolution correction data) 50^ and an adder 54 which adds the 

in C - — 

fU multiplication result of the second multiplier 53 to a low 

in 

? frequency component of the Y-signal component which is outputted 

□ • 

W 15 from the low-pass filter Y-LPF, 

PS s 

;y 

Cn [0093] The peripheral MTF correction data 50 are calculated 

C3 

M by the correction value table 211g and the correction value 

generator 211h. That is, as j = njbhe. _ca.se, _of the standard light 
amount correction data for the image field edge brightness 

20 reducij^njcox^^ at the central points 

of the respective blocks Bk (denoted at Pc in Fig. 9 and Pel 
through Pc4 in Fig. 10) are stored in the correction value memory 
4 6 (Fig. 11) in advance as standard MTF correction data, the 
HV decoder 45 decodes the count result of the HV counter 211f , 

25 and as shown in Fig. 10, the four neighboring blocks Fl through 
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F4 associated with the target pixel Px are selected, the standard 
MTF correction data are read out from the correction value memory 
4 6 and outputted to the register 4 6a which is disposed within 
the correction value generator 211h. With respect to the 
5 frequency of this, the standard MTF correction data regarding 
the four neighboring blocks Fl through F4 are outputted for every 
64 pixels, since the data are read continuously in a horizontal 
pixel direction during the image processing. 

[0094] The count result of the HV counter 211f is supplied 

*3 10 to the correction value generator 211h as well as described above, 

£0 as a value of remainder divided by 64 in the horizontal direction 

M 

*J and remainder divided by 4 8 in the vertical direction. In the 

m 

rU correction value generator 211h, the HV distance calculator 47 

in 

* calculates distances between the target pixel Px and the 

£3 

W 15 reference positions Pel through Pc4 of the four neighboring 

ru 

CP blocks Fl through F4 as those shown in Fig. 10 based on the count 

C3 

M result of the HV counter 211f. 

[0095] Following this, the multipliers 48 multiply the four 
pieces of the standard MTF correction data stored within the 
20 register 46a with the distance values stored in the distance 
registers Rl through R4, the adder 4 9 adds up the four values 
multiplied by the multipliers 48 and calculates a correction 
value . 

[0096] As in the case of the standard light amount correction 
25 data, the standard MTF correction data within the correction 
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value memory 46 are stored in the flash ROM 231, and the values 
of the data can be changed appropriately in accordance with an 
optical condition. Other similarities to the edge brightness 
reduction correction include reading of the standard MTF 
correction data from the flash ROM 231 in accordance with 
predetermined optical conditions such as a zooming position and 
the aperture stop manipulated by a user. 

[0097] As described above, during the shading correction, 
the image is divided into the plurality of rectangular blocks 
Bk which have a constant size, representative correction data 

(standard light amount correction data) which correspond on 
one-to-one basis to predetermined reference positions within 
the respective blocks Bk are held, the representative light 
amount correction data regarding the four neighboring blocks 
Fl through F4 associated with the target pixel Px are weighted 
depending on the position of the target pixel Px to calculate 
a correction value for the target pixel Px, and each target pixel 
Px is shading-corrected using the correction value. Hence, it 
is possible to prevent boundaries between the blocks Bk from 
becoming noticeable, and hence, to better improve the quality 
of the image, as compared with the conventional approaches which 
require to perform the shading correction on all pixels within 
each block Bk using one correction value. 

[0098] Further, since only one piece of the representative 
light amount correction data is held for each one of the respective 




blocks Bk, as compared with the conventional approaches which 
require to hold correction values for all pixels in advance, 
it is possible to largely reduce the data volume of light amount 
correction data which are to be prepared. Hence, for shading 
5 correction using different correction values in accordance with 
predetermined optical conditions such as zooming and a stop, 
or for realization of a high resolution by means of an increased 
number of elements of the CCD and hence an increased number of 
pixels, it is possible to largely suppress the data volume of 
C3 10 light amount correction data which are to be prepared, and 
03 therefore, to reduce a load during data processing. 

Sj [0099] Peripheral MTF correction for each one of the blocks 

in 

fU Bk is possible which has not been heretofore possible, utilizing 

in 

* weighting of the representative resolution correction data 

□ 

W 15 (standard MTF correction data) for each block similar to that 

ru 

CH in the shading correction, and therefore, as in the case of the 

O 

!«* shading correction described above, the peripheral MTF 

correction makes it possible to largely improve the quality of 
the image without making boundaries between the blocks Bk 
20 noticeable. With respect to the correction values as well, as 
in the case of the shading correction, one piece of the 
representative resolution correction data may be prepared for 
each one of the respectiveblocks Bk, and therefore, itispossible 
to perform the peripheral MTF correction by means of image signal 
25 processing with a small load while suppressing the data volume 
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of the entire resolution correction data. 



[0100] The same HV counter 211f , the correction value table 
211g and the correction value generator 211h are time-shared 
between the shading correction and the peripheral MTF correction 
5 simply by setting the blocks Bk to be divided commonly to the 
image signal processing in the shading correction and the image 
signal processing in the peripheral MTF correction and by 
switching the data table within the correction value table 211g 
with the data table of the standard light amount correction data 
O 10 for the shading correction and the standard MTF correction data 
CO for the peripheral MTF correction. Hence, particularly when 

Sj these elements 211f , 211g and 211h are realized with hardware, 

in 

fU it is possible to make as effective use as possible of the same 

m 

a hardware resource, which leads to an improved efficiency in terms 

|d 15 of the circuitry structure. 

fU 

{h [0101] While an image is divided uniformly into the 

C3 

M' rectangular blocks Bk which have the same shape and are each 

164 pixels in the horizontal direction and 48 pixels in the vertical 
/ direction and the representative correction data (light amount 
20 I correction data and resolution correction data) are held for 
I each in the preferred embodiment above, since it is desirable 
to change the correction data more finely in a peripheral portion 
than in a central portion considering properties of the lenses, 
as shown in Fig. 14, the block size of a block Bko in a peripheral 
25 area may be set smaller relative to the block size of a block 
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Bki in a central area, so that the shading correction and the 
peripheral MTF correction are executed more finely in the 
peripheral area than in the central area. 
[0102] Further, while the representative light amount 
correction data and the representative resolution correction 
data are provided using the central points of the respective 
blocks as the reference positions in the preferred embodiment 
above, the reference positions may not necessarily be the central 
points as long as the reference positions remain the same among 
the respective blocks. For instance, the reference positions 
Pc may be corner points as shown in Fig. 15. 

[0103] Using the structure above, in a condition that the 
entire area of an image which is captured by the image pickup 
element is divided into a plurality of rectangular blocks and 
the correction value memory holds the light amount correction 
data each set in advance for each one of the blocks, the correction 
value generator weights, in accordance with the position of a 
target pixel, the light amount correction data or resolution 
correction data regarding a plurality of blocks which are 
mutually adjacent in the vicinity of the target pixel to thereby 
generate a correction value for the target pixel, and each pixel 
is corrected through the image field edge brightness reduction 
correction based on such correction value, as described in the 
inventions defined in claims 5 and 6. Hence, as compared with 
the conventional approaches which require to perform the image 



field edge brightness reduction correction on all pixels within 
each block using the same correction value, it is possible to 
prevent boundaries between the blocks Bk f rombecomingnoticeable, 
and hence, to better improve the quality of the image. 
[0104 ] In addition, since only one piece of the representative 
light amount correction data is held in advance for each block, 
it is possible to largely reduce the data volume of light amount 
correction data which are to be prepared, as compared with the 
conventional approaches which require to hold correction values 
for all pixels in advance. 

[0105] Further, using the structure above, in a condition 
that the correction value memory holds in advance the resolution 
correction data each set in advance for each one of the blocks 
which are obtained by dividing the entire area of an image which 
is captured by the image pickup element into at least a central 
area and a peripheral area, the respective pixels are 
edge-enhanced based on the resolution correction data to thereby 
execute the image field edge resolution reduction correction. 
Hence, it is possible to level out resolutions of the image and 
improve the quality of the image. 

[0106] Further, since only one piece of the representative 
resolution correction data is held in advance for each block, 
it is possible to largely reduce the data volume of resolution 
correction data which are to be prepared, as compared with the 
conventional approaches which require to hold correction values 



for all pixels in advance. 

[0107] Further, the correction values regarding the 
resolutions at the respective target pixels within the blocks 
are generated based on the resolution correction data which are 
5 held in the correction value memory, and the edge enhancer 
edge-enhances the respective pixels based on the correction 
values and the pixels are consequently treated with the image 
field edge brightness reduction correction. Hence, as compared 
with the conventional approaches which require to correct the 
^3 10 resolutions at all pixels within each block using the same 
CO correction value, it is possible to prevent boundaries between 

^ the blocks from becoming noticeable, andhence, to better improve 

in 

the quality of the image. 

in 

5 [0108] Further, when the image data treated with the image 

P 

W 15 field edge brightness reduction correction are stored in the 

ru 

CP image memory and the image data are further treated with the 

Q 

M 5 image field edge resolution reduction correction, the same 

correction value memory and the same correction value generator 
are shared between correction of image field edge brightness 

20 reductions, and correction of image field edge resolution 
reductions and correction values for these processes are 
generated in a time-shared manner. Hence, it is possible to 
make as effective use as possible of the same hardware resource, 
which leads to an improved efficiency in terms of the circuitry 

25 structure. 
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[0109] Further, the correction value memory holds the light 
amount correction data or the resolution correction data which 
become different depending on optical conditions, such as zooming 
up or down and manipulation of a stop, during imaging, it is 
5 possible to execute correction of image field edge brightness 
reductions and/or correction of image field edge resolution 
reductions which is appropriate to parameters of the optical 
conditions. Particularly since only one piece of the 
representative light amount data or the representative 
P 10 resolution correction data is held in advance for each block, 
CO it is possible to largely reduce the data volume of light amount 

M correction data or resolution correction data which are to be 

fU prepared, as compared with the conventional approaches which 

in 

■ require to hold correction values for all pixels in advance. 

□ 

UJ 15 [0110] Further, since the blocks in the peripheral area are 

§y 

CP set to be smaller than the blocks in the central area, it is 

P 

possible to change the correction data more finely in the 
peripheral area than in the central area, which in turn realizes 
an effect that an image quality is improved particularly in the 

20 peripheral area. 

[0111] Although the present invention has been fully 
described by way of examples with reference to the accompanying 
drawings, it is to be noted that various changes andmodif ications 
will be apparent to those skilled in the art. Therefore, unless 

25 otherwise such changes and modifications depart from the scope 
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of the present invention, they should be construed as being 
included therein. 
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